Image processing apparatus, image processing method, and image processing program

ABSTRACT

An image processing apparatus, an image processing method, and an image processing program for relatively easily creating an album similar to an example album are provided. A page of an example album is displayed in a page display region, and one example image among images pasted on the page is displayed in an example image display region. An image similar to the example image is displayed in a selected image region. In a case where a decision button is clicked, the image is pasted at a position at which the example image is pasted. Similarly, an album is created by finding images similar to example images and the like pasted in an image pasting region. The album similar to the example album is created.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Divisional Application of U.S. patent applicationSer. No. 17/200,156 filed on Mar. 12, 2021, which is a Continuation ofPCT International Application No. PCT/JP2019/030335 filed on Aug. 1,2019, which claims priority under 35 U.S.C. § 119(a) to Japanese PatentApplications No. 2018-178684 filed on Sep. 25, 2018. Each of the aboveapplication(s) is hereby expressly incorporated by reference, in itsentirety, into the present application.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The invention relates to an image processing apparatus, an imageprocessing method, and an image processing program.

2. Description of the Related Art

There are increasing opportunities to perform capturing along withwidespread use of a digital camera, a smartphone, or the like, and thenumber of images obtained by capturing has been significantly increased.Many images are mostly recorded in a main body of the digital camera,the smartphone, or the like, a memory card, or the like in an image dataformat. Finding a desired image from a significantly large number ofimages is difficult, and thus, there may be few opportunities to browsea captured image. Thus, it is considered that the desired image is keptas a paper album from a large number of captured images. For example, aphoto book is created in a layout corresponding to a worldview of apicture book (JP2016-018418A), or an album of the same quality can becreated (JP2005-184789A). In addition, since adjustment such as imagecorrection may be performed in a case of editing the album, it isconsidered that a sample image is displayed at a time of adjustment suchas the image correction (JP2010-198078A).

SUMMARY OF THE INVENTION

In a case of creating the album, a user may feel significantlyinconvenient in a case where the user performs all of selection of animage to be pasted in the album, decision of a position at which theselected image is to be pasted in the album, decision of a size of theimage to be pasted in the album, and the like. An image appropriate forthe album may not be selected, or the image may not be pasted at anappropriate position, and a degree of completion of the album may bedecreased. In JP2016-018418A, an album having the worldview of thepicture book is created, and creating an album having a high degree ofcompletion relatively easily is not considered. In JP2005-184789A, asample image having composition of an image to be inserted into an imageinsertion region of a template is inserted into the image insertionregion as a guidance image. However, the image insertion region of thetemplate displayed on a display screen is relatively small, and thus,the guidance image is not easily viewed, and it is difficult to selectthe image to be inserted into the image insertion region of thetemplate. In JP2010-198078A, creating the album is not considered.

An object of the invention is to enable an album having a high degree ofcompletion to be relatively easily created.

An image processing apparatus according to the invention comprises afirst display control device (first display control means) that controlsa display device to display a first display region on a display screen,the first display region displaying a page of an album composed of aplurality of pages, a second display control device (second displaycontrol means) that controls the display device to display a seconddisplay region on the display screen, the second display regiondisplaying one image of images pasted in an image pasting region of thepage displayed in the first display region, and a third display controldevice (third display control means) that controls the display device todisplay a third display region on the display screen, the third displayregion displaying an image different from the image displayed in thesecond display region.

The invention also provides an image processing method appropriate forthe image processing apparatus. That is, the method comprisescontrolling a display device to display a first display region on adisplay screen by a first display control device, the first displayregion displaying a page of an album composed of a plurality of pages,controlling the display device to display a second display region on thedisplay screen by a second display control device, the second displayregion displaying one image of images pasted in an image pasting regionof the page displayed in the first display region, and controlling thedisplay device to display a third display region on the display screenby a third display control device, the third display region displayingan image different from the image displayed in the second displayregion.

In the invention, an image processing apparatus may include a processor,and the processor may control a display device to display a firstdisplay region on a display screen, the first display region displayinga page of an album composed of a plurality of pages, control the displaydevice to display a second display region on the display screen, thesecond display region displaying one image of images pasted in an imagepasting region of the page displayed in the first display region, andcontrol the display device to display a third display region on thedisplay screen, the third display region displaying an image differentfrom the image displayed in the second display region.

The invention also provides a program that controls a computer of animage processing apparatus and is readable by the computer, and arecording medium storing the program.

For example, the third display control device may display, in the thirddisplay region, an image of which a degree of similarity with the imagedisplayed in the second display region is greater than or equal to athreshold value.

An image input device that inputs a plurality of images may be furthercomprised. In this case, for example, the third display control devicemay display, in the third display region, an image of which a degree ofsimilarity with the image displayed in the second display region isgreater than or equal to a threshold value among the plurality of imagesinput from the image input device.

A fourth display control device (means) that controls the display deviceto display a fourth display region on the display screen, the fourthdisplay region displaying the plurality of images input from the imageinput device, may be further comprised.

For example, the fourth display control device may display, in thefourth display region, the plurality of images input from the imageinput device in order of a degree of similarity with images to bedisplayed in the third display region.

The degree of similarity may be increased as at least one of the degreeof similarity with the image displayed in the second display region, adegree of matching of information with respect to a face included in theimage displayed in the second display region, or a degree of matching ofa capturing timing with respect to the image displayed in the seconddisplay region is increased.

A designation device that designates any image of the plurality ofimages displayed in the fourth display region may be further comprised.In this case, for example, the third display control device displays theimage designated by the designation device in the third display region.

A fifth display control device (fifth display control means) thatcontrols the display device to display a fifth display region on thedisplay screen, the fifth display region displaying at least one albumof a plurality of albums, may be further comprised. In this case, forexample, the first display control device displays, in the first displayregion, a page of the album displayed in the fifth display region.

A selection device that selects a template of an album may be furthercomprised. In this case, for example, the fifth display control devicedisplays an album corresponding to the template selected by theselection device in the fifth display region.

It is preferable that, at least, one of the first display control deviceor the second display control device displays the image that is to bedisplayed in the second display region among the images included in thepage displayed in the first display region to be smaller than the imagedisplayed in the second display region.

An instruction input device that inputs an instruction to display animage other than the image displayed in the second display region may befurther comprised. In this case, for example, it is preferable that thesecond display control device displays, in the second display region,the image other than the image displayed in the second display regionamong the images included in the page displayed in the first displayregion in accordance with the instruction input from the instructioninput device.

An image product creation device (image product creation means) thatcreates an image product using the image displayed in the third displayregion may be further comprised.

For example, the image product creation device creates an album as theimage product by pasting the image displayed in the third display regionin an image pasting region corresponding to the image displayed in thesecond display region on the page displayed in the first display region.

According to the invention, since a consulted image is displayed in thesecond display region by displaying a page of a consulted album in thefirst display region, an image to be pasted in a region corresponding tothe image pasting region of the consulted album can be found bydisplaying an image in the third display region by consulting the imagedisplayed in the second display region. An album similar to theconsulted album can be relatively easily created.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a summary of an image processing system.

FIG. 2 is a block diagram illustrating an electric configuration of aclient computer.

FIG. 3 is a flowchart illustrating a processing procedure of the clientcomputer.

FIG. 4 is a flowchart illustrating a processing procedure of the clientcomputer.

FIG. 5 is one example of an album creation window.

FIG. 6 illustrates a relationship and the like between a template and anexample album.

FIG. 7 illustrates each page constituting the example album.

FIG. 8 is one example of the album creation window.

FIG. 9 is a flowchart illustrating a processing procedure of switchingan example image.

FIG. 10 is one example of an example page.

FIG. 11 is one example of a page of a created album.

FIG. 12 illustrates a flow and the like of wedding ceremony.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIG. 1 illustrates an example of the invention and illustrates a summaryof an image processing system.

The image processing system is a system that creates an album byextracting an image from a plurality of images.

The image processing system includes a client computer 1 (one example ofan image processing apparatus), an order reception server 2, and aprinter 3. The client computer 1 and the order reception server 2 cancommunicate through the Internet. The printer 3 is connected to theorder reception server 2.

In the client computer 1, the image is extracted from the plurality ofimages, and image data representing the extracted image is transmittedto the order reception server 2. The image data is transmitted from theorder reception server 2 to the printer 3, and the album is created inthe printer 3 (one example of an image product creation device). Thecreated album is sent to a user of the client computer 1.

FIG. 2 is a block diagram illustrating an electric configuration of theclient computer 1.

An operation of the entire client computer 1 is managed by a centralprocessing unit (CPU) 10.

The client computer 1 includes a display device 11 that displays imagesand other information on a display screen, and a communication device 12that communicates with apparatuses and the like other than the clientcomputer 1 by connecting to the Internet and other networks. Inaddition, the client computer 1 includes a hard disk 13, a hard diskdrive 14 that accesses the hard disk 13, a memory 15 that stores dataand the like, and a keyboard 16 and a mouse 17 for inputting commandsand the like. Furthermore, the client computer 1 includes a compact discdrive 18 that accesses a compact disc 19, and a memory card reader andwriter 20 that writes data into a memory card 21 and reads out datarecorded on the memory card 21.

An operation program of the client computer 1 described later isreceived in the communication device 12 through the Internet. Thereceived operation program is installed on the client computer 1. Theoperation program may be recorded on a portable recording medium such asthe compact disc 19 and read out from the portable recording medium,instead of being received by the client computer 1 through a networksuch as the Internet and installed on the client computer 1. In thatcase, the operation program read out from the portable recording mediumis installed on the client computer 1. A computer (CPU 10) of the clientcomputer 1 can read out the operation program.

FIG. 3 and FIG. 4 are flowcharts illustrating processing procedures ofthe client computer 1.

In this example, an album that is the same as an example album iscreated by consulting an image pasted in the example album. While a caseof creating an album of a wedding ceremony is described in this example,the invention is not limited to the album of the wedding ceremony andcan also be applied to a case of creating a graduation album, an albumrepresenting a recording of growth of a child, and other albums. Anyalbum consisting of a plurality of pages in which an image (picture) ispasted, and including a leaflet, a pamphlet, and the like may be usedregardless of a title of the album.

In a case where an album creation program according to this example isstarted, an album creation window 50 illustrated in FIG. 5 is displayedon the display screen of the display device 11 (step S31).

FIG. 5 is one example of the album creation window 50.

A file menu button 51 on which a character string “file” is displayed, athumbnail menu button 52 on which a character string “number ofthumbnails” is displayed, a window menu button 53 on which a characterstring “window” is displayed, and a setting menu button 54 on which acharacter string “setting” is displayed are formed at the upper left ofthe album creation window 50. For example, the file menu button 51 isclicked by the user in a case of creating a new album. For example, thesetting menu button 54 is clicked by the user in a case of designatingan image folder that stores images to be pasted in the created newalbum.

The album creation window 50 includes an album display region 60 (oneexample of a fifth display region) in which the example album isdisplayed, a page display region 70 (one example of a first displayregion) in which an image of an example page is displayed, an exampleimage display region 80 (one example of a second display region) inwhich an example image is displayed, a selected image display region 90(one example of a third display region) in which an image selected basedon the album creation program or an image selected by the user isdisplayed, and an image list display region 100 (one example of a fourthdisplay region).

As will be described later, in a case where a template to be used in thealbum is selected by the user, a plurality of example albumscorresponding to the selected template are found. An album that is themost appropriate among the found albums is displayed in the albumdisplay region 60. A previous example button 61 on which a characterstring “previous example” is displayed, and a subsequent example button62 on which a character string “subsequent example” is displayed areformed in the album display region 60. As described above, the examplealbum is displayed in the album display region 60. An example album thatis previous to the album displayed in the album display region 60 amongthe plurality of found albums is displayed in the album display region60 by clicking the previous example button 61, and an example album thatis subsequent to the album displayed in the album display region 60among the plurality of found albums is displayed in the album displayregion 60 by clicking the subsequent example button 62. The display ofthe album may be a display of information for specifying the album, adisplay of a front cover of the album, or a display of identificationinformation such as an album number for specifying the album.Alternatively, the identification information on the album may bedisplayed in a list format.

A previous page button 71 on which a character string“previous page” isdisplayed, and a subsequent page button 72 on which a character string“subsequent page” is displayed are formed in the page display region 70.In a case where the previous page button 71 is clicked, a page that isprevious to the page displayed in the page display region 70 isdisplayed in the page display region 70. In a case where the subsequentpage button 72 is clicked, a page that is subsequent to the pagedisplayed in the page display region 70 is displayed in the page displayregion 70. As the page displayed in the page display region 70, left andright spread pages may be displayed in the page display region 70 as onepage, or any of the left and right spread pages may be displayed in thepage display region 70 as one page.

A previous image button 81 on which a character string “previous image”is displayed, and a subsequent image button 82 on which a characterstring “subsequent image” is displayed are formed in the example imagedisplay region 80. In a case where the previous image button 81 isclicked, an image that is previous to the image displayed in the exampleimage display region 80 in the page displayed in the page display region70 is displayed in the example image display region 80. In a case wherethe subsequent image button 82 is clicked, an image that is subsequentto the image displayed in the example image display region 80 in thepage displayed in the page display region 70 is displayed in the exampleimage display region 80.

A decision button 91 on which a character string “decision” is displayedis formed in the selected image display region 90. In a case where thedecision button 91 is clicked, the image displayed in the selected imagedisplay region 90 is decided as the image to be pasted in the album.

A recommended image list display region 101 that displays a list ofrecommended images, or a time-series image list display region 102 thatdisplays images in a time-series order is displayed in the image listdisplay region 100. A recommendation tab on which a character string“recommendation” is displayed is formed at the upper left of therecommended image list display region 101. The recommended image list,display region 101 is displayed in the image list display region 100 byclicking the recommendation tab. A time-series tab on which a characterstring “time-series” is displayed is formed at the upper left of thetime-series image list display region 102. The time-series image listdisplay region 102 is displayed in the image list display region 100 byclicking the time-series tab. The album display region 60, the pagedisplay region 70, the example image display region 80, the selectedimage display region 90, and the image list display region 100 mayoverlap with each other or may be displayed without overlap.

In a case where the album creation window 50 is displayed, the userdesignates the image folder storing the images to be used in the album(step S32 in FIG. 3 ). In a case where the setting menu button 54 isclicked by the user, a setting menu appears on the display screen of thedisplay device 11. In a case where a menu “folder” included in thesetting menu is clicked, a folder reference window (not illustrated)appears on the display screen of the display device 11, and a desiredimage folder is designated using the mouse 17.

Next, the user selects the template to be used in the album (step S33 inFIG. 3 ). In a case where the file menu button 51 is clicked by theuser, a file menu appears on the display screen of the display device11. In a case where a menu “new creation” included in the file menu isclicked, a new creation window (not illustrated) appears on the displayscreen of the display device 11, and a desired template is selectedusing the mouse 17 (one example of a selection device).

In a case where the template is selected, an appropriate album is foundas follows from example albums created in the past using the selectedtemplate (step S34).

FIG. 6 illustrates a relationship and the like between the template (itis assumed that a template T1 is selected) selected by the user and theexample albums created using the template.

It is assumed that the example albums created using the template T1include an example album Ab1 to an example album Ab10. In the examplealbum Ab1, an example image Ir100 to an example image Ir199 are pastedin an image pasting region of the template T1.

FIG. 7 illustrates a part of pages constituting the example album Ab1.

The example album Ab1 includes a first page to an eighteenth page in aspread (excluding a front cover and a back cover). The example imageIr100 to the example image Ir104 are pasted on the first page inaccordance with a layout of the template T1. The example image Ir105 tothe example image Ir109 are pasted on the second page in accordance withthe layout of the template T1. Example images are also pasted on theother pages in accordance with the layout of the template T1. Theexample image Ir195 to the example image Ir199 are pasted on theeighteenth page in accordance with the layout, of the template T1.

In the example album Ab2 to the example album Ab10 other than theexample album Ab1, an example image Ir200 to an example image Ir1099 arepasted in accordance with the layout of the template T1 like the examplealbum Ab1. The example images Ir200 to Ir299, Ir300 to Ir399, Ir400 toIr499, Ir500 to Ir599. Ir600 to Ir699, Ir700 to Ir799, Ir800 to Ir899,Ir900 to Ir999, and Ir1000 to Ir1099 are pasted in the example albumsAb2, Ab3, Ab4, Ab5, Ab6, Ab7, Ab8, Ab9, and Ab10, respectively.

An example image of which a degree of similarity with the images storedin the image folder set by the user is greater than or equal to athreshold value is found among the example images Ir100 to Ir1099 pastedin the example albums Ab1 to Ab10. An example album in which the foundexample image of which the degree of similarity is greater than or equalto the threshold value is most frequently used is appropriate as anexample album to be used by the user.

The example album found in such a manner is displayed in the albumdisplay region 60 by the CPU 10 (one example of a fifth display controldevice) (step S35 in FIG. 3 ). In this example, it is assumed that theexample album Ab1 is the appropriate example album.

FIG. 8 is one example of the album creation window 50.

A front cover 64 of the example album Ab1 is displayed in the albumdisplay region 60 of the album creation window 50. By viewing the frontcover 64, the user perceives that the album may be created by consultingthe example album Ab1 having the front cover 64. A front cover of any ofthe example albums Ab2 to Ab10 other than the front cover 64 of theexample album Ab1 displayed in the album display region 60 is displayedin the example album display region 60 by clicking the previous examplebutton 61 or the subsequent example button 62. A character string 63indicating an ordinal number of the example album of which the front,cover is displayed among the example albums Ab1 to Ab10 of the templateT1 selected by the user is displayed at the center of a lower portion ofthe example album display region 60. A denominator of the characterstring 63 is the number of example albums Ab1 to AB10 of the template T1selected by the user, and a numerator of the character string 63 is anumber indicating the ordinal number of the album displayed in the albumdisplay region 60.

In an initial state of the page display region 70 displayed by the CPU10 (one example of a first display control device), the first page ofthe album displayed in the album display region 60 is displayed (stepS36 in FIG. 3 ). In the example illustrated in FIG. 8 , since the frontcover 64 of the example album Ab1 is displayed in the album displayregion 60, a first page 74 of the example album Ab1 is displayed. Asdescribed above, the example images Ir100, Ir101, Ir102, Ir103, andIr104 are pasted on the first page 74. A page previous to the pagedisplayed in the page display region 70 is displayed in the page displayregion 70 by clicking the previous page button 71 (in this case, sincethe previous page is not present, the previous page button 71 cannot beclicked). A page subsequent to the page displayed in the page displayregion 70 is displayed in the page display region 70 by clicking thesubsequent page button 72. A character string 73 that indicates anordinal number of the page displayed in the page display region 70 inthe example album is displayed at the center of a lower portion of thepage display region 70. A denominator of the character string 73 is thetotal number of pages of the album, and a numerator of the characterstring 73 indicates the ordinal number of the page displayed in the pagedisplay region 70.

Furthermore, in an initial state of the example image display region 80displayed by the CPU 10 (one example of a second display controldevice), the first image of the images pasted on the page displayed inthe page display region 70 is displayed (step S37 in FIG. 4 ). In theexample illustrated in FIG. 8 , since the first page 74 of the examplealbum Ab1 is displayed in the page display region 70, the first exampleimage Ir100 (one example of one image) of the first page 74 is displayedin the example image display region 80. The example image Ir100displayed in the page display region 70 is smaller than the exampleimage Ir100 displayed in the example image display region 80. Theexample image Ir100 displayed in the example image display region 80 islarger and thus, is easily checked. Among the example images Ir100 toIr104 pasted on the page 74 displayed in the page display region 70, animage previous to the example image Ir100 displayed in the example imagedisplay region 80 is displayed in the example image display region 80 byclicking the previous image button 81 (in this case, since the imageprevious to the example image Ir100 is not present, the previous imagebutton 81 cannot be clicked; however, the last example image of imagespasted on a page previous to the page on which the example image Ir100is pasted may be displayed). An image subsequent to the image Ir100displayed in the example image display region 80 is displayed in theexample image display region 80 by clicking the subsequent image button82. A character string 83 that indicates an ordinal number of theexample image Ir100 displayed in the example image display region 80 onthe page is displayed at the center of a lower portion of the exampleimage display region 80. A denominator of the character string 83indicates the total number of images on the page on which the exampleimage Ir100 is displayed, and a numerator of the character string 83indicates the ordinal number of the example image Ir100 among the imagesdisplayed on the page.

A degree of similarity with the example image Ir100 displayed in theexample image display region 80 is calculated for the images stored inthe image folder selected by the user {images that are recorded on thememory card 21 or the like and are read out into the client computer bythe memory card reader and writer 20 (one example of an image inputdevice that inputs a plurality of images)}. An image of which the degreeof similarity with the example image Ir100 displayed in the exampleimage display region 80 is greater than or equal to the threshold valueand is the highest is found from the images stored in the image folderselected by the user (step S38 in FIG. 4 ). The found image is displayedin the selected image display region 90 displayed by the CPU 10 (oneexample of a third display control device) as a selected image 92 (oneexample of an image different from an image displayed in a seconddisplay region) (step S39 in FIG. 4 ). In a case where the decisionbutton 91 formed in the selected image display region 90 is clicked, theselected image 92 displayed in the selected image display region 90 isdecided as an image to be pasted at a position of the page at which theexample image Ir100 is pasted.

Next, an image of which the degree of similarity with the example imageIr100 displayed in the example image display region 80 is greater thanor equal to the threshold value is found from the images stored in theimage folder selected by the user (step S40 in FIG. 4 ). A list of foundimages is displayed in the recommended image display region 101displayed by the CPU 10 (one example of a fourth display control device)(step S41 in FIG. 4 ).

Recommended images I1 to I15 are displayed in the recommended imagedisplay region 101 in a descending order of the degree of similaritywith the example image Ir100 displayed in the example image displayregion 80. Images similar to the example image can be perceived. Imagesnot displayed in the recommendation region 101 are displayed in therecommended image display region 101 by scrolling. Checkboxes B1 to B15are formed on a left side of the recommended images I1 to I15. Therecommended image I1 is displayed in the selected image display region90 among the recommended images I1 to I15 displayed in the recommendedimage display region 101. Thus, the checkbox B1 formed on the left sideof the recommended image I1 is checked. In a case of displaying an imageother than the recommended image I1 in the selected image display region90, any of the checkboxes B1 to B15 formed on the left side of therecommended image to be displayed is checked. A desired image can beselected. For example, in a case where the checkbox B2 is checked by themouse 17 (one example of a designation device), the recommended image I2corresponding to the checkbox B2 is displayed in the selected imagedisplay region 90, and the check of the checkbox B1 is deleted. Bydisplaying the desired image in the selected image display region 90,the user can decide the image to be pasted in the album while comparingthe image with the example image Ir100 displayed in the example imagedisplay region 80. Alternatively, without displaying the image listdisplay region 100 (the recommended image display region 101 and thetime-series image list display region 102), an image changing button orthe like may be disposed inside or outside the selected image displayregion 90, and the image displayed in the selected image display region90 may be switched in accordance with a click on the image changingbutton or the like. The image that is switched and displayed may be inorder of the degree of similarity with the example image Ir100 or not inorder of the degree of similarity. In a case where the number of imagesdisplayed in the recommended image display region 101 is large, thenumber of images displayed in the recommended image display region 101may be decreased by increasing the threshold value of the degree ofsimilarity. Conversely, in a case where the number of images displayedin the recommended image display region is small, the number of imagesdisplayed in the recommended image display region 101 may be increased.

In a case of the state illustrated in FIG. 8 , in a case where theprevious example button 61 formed in the album display region 60 isclicked, the front cover of the example album Ab10 is displayed insteadof the front cover 64 of the example album Ab1 displayed in the albumdisplay region 60. In a case where the subsequent example button 62formed in the album display region 60 is clicked, the front cover of thesubsequent example album Ab2 is displayed instead of the front cover 64of the example album Ab1 displayed in the album display region 60. In acase where the previous example button 61 is clicked, the first page ofthe example album Ab10 is displayed in the album display region 60. In acase where the subsequent example button 62 is clicked, the first pageof the example album Ab2 is displayed in the album display region 60.

In a case where a page previous to the page 70 displayed in the pagedisplay region 70 is present, the previous page is displayed in the pagedisplay region 70 in a case where the previous page button 71 isclicked. The first example image of the previous page is displayed inthe example image display region 80. In a case where a page subsequentto the page 70 displayed in the page display region 70 is present, thesubsequent page is displayed in the page display region 70 in a casewhere the subsequent page button 72 is clicked. The first example imageof the subsequent page is displayed in the example image display region80.

In a case where the previous image button 81 or the subsequent imagebutton 82 formed in the example image display region 80 is clicked, aswitching instruction is generated, and the example image displayed inthe example image display region 80 is switched. However, even in a casewhere the previous image button 81 or the subsequent image button 82formed in the example image display region 80 is not clicked, theswitching instruction is generated by clicking the previous examplebutton 61 or the subsequent example button 62 formed in the albumdisplay region 60, or the previous page button 71 or the subsequent pagebutton 72 formed in the page display region 70, and the example imageIr100 displayed in the example image display region 80 is switched.

FIG. 9 is a flowchart illustrating a processing procedure of the clientcomputer 1 in a case where the switching instruction is generated.

As described above, in a case where the previous example button 61, thesubsequent example button 62, the previous page button 71, thesubsequent page button 72, the previous image button 81, or thesubsequent image button 82 (one example of an instruction input device)is clicked, the switching instruction is generated, and the exampleimage corresponding to the clicked button is displayed in the exampleimage display region 80 (step S101).

In a case where a new example image (one example of an image other thanthe image displayed in the example image display region 80 among theimages included in the page displayed in the page display region 70) isdisplayed in the example image display region 80 by switching theexample image displayed in the example image display region 80 (stepS102), the degree of similarity with the switched example image iscalculated for the images stored in the image folder designated by theuser. An image of which the calculated degree of similarity is thehighest is found (step S103), and the found image is displayed in theselected image display region 90 (step S104). In addition, images ofwhich the degree of similarity is greater than or equal to the thresholdvalue are found from the images stored in the image folder designated bythe user (step S105), and the images stored in the image folderdesignated by the user are displayed in the recommended image displayregion 101 in a descending order of the degree of similarity (stepS106).

In such a manner, each time the example image displayed in the exampleimage display region 80 is changed, the image displayed in the selectedimage display region 90 is switched, and the images displayed in therecommended image display region 101 and a display order of the imagesare also changed.

FIG. 10 is one example of the example page 74 displayed in the pagedisplay region 70 and is enlarged compared to the example page 74illustrated in FIG. 8 . FIG. 11 is one example of a page Pg constitutingthe album created by consulting the example page 74.

With reference to FIG. 10 , image pasting regions Ar1, Ar2, Ar3, Ar4,and Ar5 are formed on the example page 74, and the example images Ir100,Ir101, Ir102. Ir103, Ir104, and Ir105 are pasted in the image pastingregions Ar1, Ar2, Ar3, Ar4, and Ar5, respectively.

With reference to FIG. 11 , the image pasting regions Ar1, Ar2, Ar3,Ar4, and Ar5 are formed on the page Pg in the same layout as the examplepage. Images Ir1, Ir21, Ir22, Ir12, and Ir11 stored in the image folderselected by the user are pasted in the image pasting regions Ar1, Ar2,Ar3, Ar4, and Ar5, respectively.

The image Ir1 pasted in the image pasting region Ar1 of the page Pgillustrated in FIG. 11 is an image that is selected by consulting theimage Ir100 pasted in the image pasting region Ar1 of the example page74 illustrated in FIG. 10 and has a high degree of similarity ofcomposition or the like. Similarly, all of the example image Ir101pasted in the image pasting region Ar2 in FIG. 10 and the image Ir21pasted in the image pasting region Ar2 in FIG. 11 , the example imageIr102 pasted in the image pasting region Ar3 in FIG. 10 and the imageIr22 pasted in the image pasting region Ar3 in FIG. 11 , the exampleimage Ir103 pasted in the image pasting region Ar4 in FIG. 10 and theimage Ir12 pasted in the image pasting region Ar4 in FIG. 11 , and theexample image Ir104 pasted in the image pasting region Ar5 in FIG. 10and the image Ir11 pasted in the image pasting region Ar5 in FIG. 11 arepairs of images having a high degree of similarity of composition or thelike. The album of the page Pg having the same impression as the examplepage 74 is created. By transmitting data representing the page Pggenerated in such a manner to the order reception server 2, a paperalbum is created by the printer 3. Alternatively, data representing thealbum may be created in the order reception server 2 by transmittingtemplate data, data representing the selected image, and data indicatinga pasting position or the like of the image to the order receptionserver 2. A page other than the page Pg can also be created in the samemanner as the example page of the example album, and the user can createthe same album as the example album.

While the image displayed in the selected image display region 90, theimages displayed in the recommended image display region 101, and theorder of the images are decided based on the degree of similarity withthe example image displayed in the example image display region 80, thedegree of similarity may be not only the degree of similarity obtainedby simply comparing images but also a degree of matching betweeninformation on a face included in the example image and information on aface included in the images stored in the image folder selected by theuser (the information on the face is any information perceived from theface and may be any of the number of faces included in the image, a sizeof the face with respect to the image, or a sex perceived from theface). For example, face recognition processing may be performed on eachof the face included in the example image and the face included in theimages stored in the image folder designated by the user, and the degreeof matching of the face obtained from the face recognition may be usedas the degree of similarity. Alternatively, a degree of similaritybetween capturing timings of images may be used as the degree ofsimilarity. For example, in a case where the degree of matching betweena capturing timing of the example image and a capturing timing of theimages stored in the image folder designated by the user is high, thedegree of similarity may be high.

FIG. 12 illustrates a relationship between a flow of wedding ceremonyand timings at which the example images Ir100 to Ir199 pasted on eachpage of the example album Ab1 are captured at the wedding ceremony.

For example, the wedding ceremony is started at time t0, and abridegroom and a bride enter from time t0 to time t1. The bridegroom andthe bride are introduced from time t1 to time t2, and greeting of anhonored guest is performed from time t2 to time t3. A toast is made fromtime t3 to time t4. A wedding cake is cut from time t4 to time t5.Conversation and dining are performed from time t5 to time 16. Guestentertainment is performed from time t6 to time t7. Flower bouquets arepresented to parents from time t7 to time t8. Acknowledgement of thebridegroom and the bride is performed from time t8 to time t9. In such amanner, in an event such as the wedding ceremony, a general flow isdecided, and a target captured in each time range is also decided.

In the example album, example images having contents following the flowin the event are pasted in the example album. For example, imagescorresponding to “entrance of the bridegroom and the bride” performedfrom time t0 to time t1 are pasted on the first page and the second pageof the example album. Images corresponding to “introduction of thebridegroom and the bride” are pasted on the third page and the fourthpage of the example album. Similarly, images corresponding to “greetingof the honored guest” are pasted on the fifth page of the example album.Images corresponding to “toast” are pasted on the sixth page of theexample album. Images corresponding to “cutting of the wedding cake” arepasted on the seventh page and the eighth page of the example album.Images corresponding to “conversation and dining” are pasted on theninth page to the twelfth page of the example album. Imagescorresponding to “guest entertainment” are pasted on the thirteenth pageto the fifteenth page of the example album. Images corresponding to“presentation of the flower bouquets” are pasted on the sixteenth pageand the seventeenth page of the example album. Images corresponding to“acknowledgement” are pasted on the eighteenth page of the examplealbum.

A capturing time is recorded in a header of an image file. Thus, acapturing timing at which the image is captured is perceived byconsulting the capturing time. Among the images stored in the image fileselected by the user, the degree of similarity of an image having thesame capturing timing as the capturing timing of the image displayed inthe example image display region 80 can be corrected to be increased,and the degree of similarity of an image having a capturing timingdifferent from the capturing timing of the image displayed in theexample image display region 80 can be corrected to be decreased. Animage of which the corrected degree of similarity is the highest can bedisplayed in the selected image display region 90. In addition, theimages can be displayed in the recommendation region 101 in a descendingorder of the corrected degree of similarity. For example, in FIG. 8 , ina case where the capturing timing is not considered, it is assumed thatthe degree of similarity between the example image Ir100 and the imageI1 is 0.8, and that the degree of similarity between the example imageIr100 and the image Ir2 is 0.75. In a case where the capturing timing isnot, considered, the image I1 is found as the image of which the degreeof similarity with the example image Ir100 is the highest, and the imageI1 is displayed in the selected image display region 90. Meanwhile, theexample image Ir100 is an image of the first page and thus, isconsidered to be an example image of a scene of “entrance of thebridegroom and the bride” from time t0 to time t1. It is assumed thatthe image I1 is captured in a scene of “presentation of the flowerbouquets” from time t7 to time t8, and that the image I2 is captured inthe scene of “entrance of the bridegroom and the bride” from time t0 totime t1. The image I2 is an image captured in the scene of “presentationof the flower bouquets” and is considered not to be suitable for thefirst page and the second page on which the images of“entrance of thebridegroom and the bride” are pasted. For example, a correction value ofthe degree of similarity of the capturing timing of the image I1 is 0,and a correction value of the degree of similarity of the capturingtiming of the image I2 is 0.1. The degree of similarity of the image I1is 0.8+0=0.8 since the correction value is 0, and the degree ofsimilarity of the image I2 is 0.75+0.1=0.85 since the correction valueis 0.1. The degree of similarity of the image I2 is greater than thedegree of similarity of the image I1, and the image I2 is displayed inthe selected image display region 90.

In such a manner, the degree of similarity may be increased consideringthe capturing timing. The capturing timing may be the capturing time.

In the above example, images to be displayed in the recommended imagedisplay region 101 are selected and displayed in accordance with amagnitude of the degree of similarity, and images to be displayed in thetime-series image list display region 102 are selected in accordancewith a time series. Alternatively, other selection methods and displaymethods may be employed. For example, while the images to be displayedin the recommended image display region 101 are selected in accordancewith the magnitude of the degree of similarity in a case where thedegree of matching of the capturing timing is not considered, a displaymethod of providing a mark indicating preference near an image of whichthe degree of matching of the capturing timing is higher than athreshold value may be employed. In addition, for example, whileselection of the images to be displayed in the time-series image listdisplay region 102 in accordance with the time series does not changefrom the above example, a display method of providing the markindicating preference near an image of which the degree of similaritywith the image displayed in the example image display region 80 ishigher than the threshold value may be employed.

While the album of the wedding ceremony is created in the above example,an album other than the album of the wedding ceremony may be created byconsulting the example album. For example, an album summarizing schoolevents for one year may be created. In this case, even in a case where anew album is created using an album created one year ago as an example,the degree of similarity between images captured in the same time periodmay be increased since events performed for one year are generallyperformed in the same time period each year.

Processing portions executing the above processing include not only theCPU 10 that functions as various processing portions by executingsoftware, but also a programmable logic device such as afield-programmable gate array (FPGA) that has a circuit configurationchangeable after manufacturing, a dedicated electric circuit such as anapplication specific integrated circuit (ASIC) that is a processorhaving a circuit configuration dedicatedly designed to execute aspecific type of processing, and the like.

One processing portion may be configured with one of those variousprocessors or may be configured with a combination of two or moreprocessors of the same type or different types (for example, a pluralityof FPGAs or a combination of a CPU and an FPGA). As an example ofconfiguring a plurality of processing portions with one processor,first, as represented by a computer such as a client computer or aserver, a form in which one processor is configured with a combinationof one or more CPUs and software, and in which this processor functionsas the plurality of processing portions is available. Second, asrepresented by a system on chip or the like, a form in which a processorthat implements a function of the entire system including the pluralityof processing portions in one integrated circuit (IC) chip is used isavailable. In such a manner, various processing portions are configuredusing one or more of various processors as a hardware structure.

Furthermore, the hardware structure of those various processors is morespecifically an electric circuit in which circuit elements such assemiconductor elements are combined.

What I claimed is:
 1. An image processing apparatus comprising: a firstdisplay control device that controls a display device to display a firstdisplay region on a display screen, the first display region displayinga composite of a plurality of images; a second display control devicethat controls the display device to display a second display region onthe display screen, the second display region displaying one image ofimages pasted in an image pasting region of the composite displayed inthe first display region; and a third display control device thatcontrols the display device to display a third display region on thedisplay screen, the third display region displaying an image differentfrom the image displayed in the second display region, wherein the thirddisplay control device displays, in the third display region, an imageof which a degree of similarity with the image displayed in the seconddisplay region is greater than or equal to a threshold value.
 2. Theimage processing apparatus according to claim 1, further comprising: animage input device that inputs a plurality of images, wherein the thirddisplay control device displays, in the third display region, an imageof which a degree of similarity with the image displayed in the seconddisplay region is greater than or equal to a threshold value among theplurality of images input from the image input device.
 3. The imageprocessing apparatus according to claim 2, further comprising: a fourthdisplay control device that controls the display device to display afourth display region on the display screen, the fourth display regiondisplaying the plurality of images input from the image input device. 4.The image processing apparatus according to claim 3, wherein the fourthdisplay control device displays, in the fourth display region, theplurality of images input from the image input device in order of adegree of similarity with images to be displayed in the third displayregion.
 5. The image processing apparatus according to claim 4, whereinthe degree of similarity is increased as at least one of the degree ofsimilarity with the image displayed in the second display region, adegree of matching of information with respect to a face included in theimage displayed in the second display region, or a degree of matching ofa capturing timing with respect to the image displayed in the seconddisplay region is increased.
 6. The image processing apparatus accordingto claim 3, further comprising: a designation device that designates anyimage of the plurality of images displayed in the fourth display region,wherein the third display control device displays the image designatedby the designation device in the third display region.
 7. The imageprocessing apparatus according to claim 1, wherein at least one of thefirst display control device or the second display control devicedisplays the image that is to be displayed in the second display regionamong the images included in the composite displayed in the firstdisplay region to be smaller than the image displayed in the seconddisplay region.
 8. The image processing apparatus according to claim 1,further comprising: an instruction input device that inputs aninstruction to display an image other than the image displayed in thesecond display region, wherein the second display control devicedisplays, in the second display region, the image other than the imagedisplayed in the second display region among the images included in thecomposite displayed in the first display region in accordance with theinstruction input from the instruction input device.
 9. The imageprocessing apparatus according to claim 1, further comprising: an imageproduct creation device that creates an image product using the imagedisplayed in the third display region.
 10. The image processingapparatus according to claim 9, wherein the image product creationdevice creates a composite as the image product by pasting the imagedisplayed in the third display region in an image pasting regioncorresponding to the image displayed in the second display region on thecomposite displayed in the first display region.
 11. An image processingapparatus comprising: a processor, and the processor controls a displaydevice to display a first display region on a display screen, the firstdisplay region displaying a page of a composite of a plurality ofimages, controls the display device to display a second display regionon the display screen, the second display region displaying only oneimage of images pasted in an image pasting region of the compositedisplayed in the first display region, controls the display device todisplay a third display region on the display screen, the third displayregion displaying only one image different from the only one imagedisplayed in the second display region, and controls the display deviceto display, in the third display region, an image of which a degree ofsimilarity with the image displayed in the second display region isgreater than or equal to a threshold value.
 12. An image processingmethod comprising: controlling a display device to display a firstdisplay region on a display screen by a first display control device,the first display region displaying a composite of a plurality ofimages; controlling the display device to display a second displayregion on the display screen by a second display control device, thesecond display region displaying one image of images pasted in an imagepasting region of the composite displayed in the first display region;and controlling the display device to display a third display region onthe display screen by a third display control device, the third displayregion displaying an image different from the image displayed in thesecond display region, wherein the third display control devicedisplays, in the third display region, an image of which a degree ofsimilarity with the image displayed in the second display region isgreater than or equal to a threshold value.
 13. A non-transitorycomputer-readable recording medium storing the program that controls acomputer of an image processing apparatus and is readable by thecomputer, the program controlling the computer to perform: controlling adisplay device to display a first display region on a display screen,the first display region displaying a composite of a plurality ofimages; controlling the display device to display a second displayregion on the display screen, the second display region displaying oneimage of images pasted in an image pasting region of the compositedisplayed in the first display region; and controlling the displaydevice to display a third display region on the display screen, thethird display region displaying an image different from the imagedisplayed in the second display region, wherein the third displaycontrol device displays, in the third display region, an image of whicha degree of similarity with the image displayed in the second displayregion is greater than or equal to a threshold value.